A Feud that Wasn't: Acetylcholine Evokes Dopamine Release in the Striatum

In this issue of Neuron, Threlfell et al. (2012) report that synchronous activation of cholinergic interneurons evokes striatal dopamine release by activating presynaptic nicotinic acetylcholine receptors. These findings call for a fundamental reevaluation of the long-standing view that dopamine and acetylcholine “feud” over control of striatal circuitry

Pausing to Regroup: Thalamic Gating of Cortico-Basal Ganglia Networks

How the cholinergic and dopaminergic systems of the striatum interact and how these interface with the massive neocortical input to the striatum are classic questions of cardinal interest to neurology and psychiatry. In this issue of Neuron, Ding and colleagues show that a key to these puzzles lies in the thalamic inputs to the striatum targeting its cholinergic interneurons

Investigating Habits: Strategies,Technologies and Models

Understanding habits at a biological level requires a combination of behavioral observations and measures of ongoing neural activity. Theoretical frameworks as well as definitions of habitual behaviors emerging from classic behavioral research have been enriched by new approaches taking account of the identification of brain regions and circuits related to habitual behavior. Together, this combination of experimental and theoretical work has provided key insights into how brain circuits underlying action-learning and action-selection are organized, and how a balance between behavioral flexibility and fixity is achieved. New methods to monitor and manipulate neural activity in real time are allowing us to have a first look under the hood of a habit as it is formed and expressed. Here we discuss ideas emerging from such approaches. We pay special attention to the unexpected findings that have arisen from our own experiments suggesting that habitual behaviors likely require the simultaneous activity of multiple distinct components, or operators, seen as responsible for the contrasting dynamics of neural activity in both cortico-limbic and sensorimotor circuits recorded concurrently during different stages of habit learning. The neural dynamics identified thus far do not fully meet expectations derived from traditional models of the structure of habits, and the behavioral measures of habits that we have made also are not fully aligned with these models. We explore these new clues as opportunities to refine an understanding of habits

Motivation and Affective Judgments Differentially Recruit Neurons in the Primate Dorsolateral Prefrontal and Anterior Cingulate Cortex

The judgment of whether to accept or to reject an offer is determined by positive and negative affect related to the offer, but affect also induces motivational responses. Rewarding and aversive cues influence the firing rates of many neurons in primate prefrontal and cingulate neocortical regions, but it still is unclear whether neurons in these regions are related to affective judgment or to motivation. To address this issue, we recorded simultaneously the neuronal spike activities of single units in the dorsolateral prefrontal cortex (dlPFC) and the anterior cingulate cortex (ACC) of macaque monkeys as they performed approach–avoidance (Ap–Av) and approach–approach (Ap–Ap) decision-making tasks that can behaviorally dissociate affective judgment and motivation. Notably, neurons having activity correlated with motivational condition could be distinguished from neurons having activity related to affective judgment, especially in the Ap–Av task. Although many neurons in both regions exhibited similar, selective patterns of task-related activity, we found a larger proportion of neurons activated in low motivational conditions in the dlPFC than in the ACC, and the onset of this activity was significantly earlier in the dlPFC than in the ACC. Furthermore, the temporal onsets of affective judgment represented by neuronal activities were significantly slower in the low motivational conditions than in the other conditions. These findings suggest that motivation and affective judgment both recruit dlPFC and ACC neurons but with differential degrees of involvement and timing.National Institutes of Health (U.S.) (Grant R01 NS025529)United States. Office of Naval Research (Grant N00014-07-1-0903)Cure Huntington’s Disease Initiative, Inc. (Grant A-5552)Massachusetts Institute of Technology. Simons Center for the Social BrainNational Parkinson Foundation (U.S.) (Lynn Diamond Fellowship

Habit Learning by Naive Macaques Is Marked by Response Sharpening of Striatal Neurons Representing the Cost and Outcome of Acquired Action Sequences

Over a century of scientific work has focused on defining the factors motivating behavioral learning. Observations in animals and humans trained on a wide range of tasks support reinforcement learning (RL) algorithms as accounting for the learning. Still unknown, however, are the signals that drive learning in naive, untrained subjects. Here, we capitalized on a sequential saccade task in which macaque monkeys acquired repetitive scanning sequences without instruction. We found that spike activity in the caudate nucleus after each trial corresponded to an integrated cost-benefit signal that was highly correlated with the degree of naturalistic untutored learning by the monkeys. Across learning, neurons encoding both cost and outcome gradually acquired increasingly sharp phasic trial-end responses that paralleled the development of the habit-like, repetitive saccade sequences. Our findings demonstrate an integrated cost-benefit signal by which RL and its neural correlates could drive naturalistic behaviors in freely behaving primates. Video Abstract: Feedback about the costs and benefits of our actions is an essential part of how we learn. Desrochers et al. show that neurons in the striatum of monkeys develop combined cost-benefit signals marking movement sequences that they acquire without explicit training.National Institutes of Health (U.S.) (Grant R01 EY012848)National Institutes of Health (U.S.) (Grant R01 NS025529)United States. Defense Advanced Research Projects Agency (Grant NBCHC070105)United States. Office of Naval Research (Grant N00014-07-1-0903

Habit Learning by Naive Macaques Is Marked by Response Sharpening of Striatal Neurons Representing the Cost and Outcome of Acquired Action Sequences

SummaryOver a century of scientific work has focused on defining the factors motivating behavioral learning. Observations in animals and humans trained on a wide range of tasks support reinforcement learning (RL) algorithms as accounting for the learning. Still unknown, however, are the signals that drive learning in naive, untrained subjects. Here, we capitalized on a sequential saccade task in which macaque monkeys acquired repetitive scanning sequences without instruction. We found that spike activity in the caudate nucleus after each trial corresponded to an integrated cost-benefit signal that was highly correlated with the degree of naturalistic untutored learning by the monkeys. Across learning, neurons encoding both cost and outcome gradually acquired increasingly sharp phasic trial-end responses that paralleled the development of the habit-like, repetitive saccade sequences. Our findings demonstrate an integrated cost-benefit signal by which RL and its neural correlates could drive naturalistic behaviors in freely behaving primates.Video Abstrac

Amygdala-ventral striatum circuit activation decreases long-term fear

In humans, activation of the ventral striatum, a region associated with reward processing, is associated with the extinction of fear, a goal in the treatment of fear-related disorders. This evidence suggests that extinction of aversive memories engages reward-related circuits, but a causal relationship between activity in a reward circuit and fear extinction has not been demonstrated. Here, we identify a basolateral amygdala (BLA)-ventral striatum (NAc) pathway that is activated by extinction training. Enhanced recruitment of this circuit during extinction learning, either by pairing reward with fear extinction training or by optogenetic stimulation of this circuit during fear extinction, reduces the return of fear that normally follows extinction training. Our findings thus identify a specific BLA-NAc reward circuit that can regulate the persistence of fear extinction and point toward a potential therapeutic target for disorders in which the return of fear following extinction therapy is an obstacle to treatment.National Institute of Mental Health (U.S.) (R01 MH084966)United States. Army Research OfficeUnited States. Defense Advanced Research Projects Agency (grant W911NF-10-1-0059

Differential Dynamics of Activity Changes in Dorsolateral and Dorsomedial Striatal Loops during Learning

The basal ganglia are implicated in a remarkable range of functions influencing emotion and cognition as well as motor behavior. Current models of basal ganglia function hypothesize that parallel limbic, associative, and motor cortico-basal ganglia loops contribute to this diverse set of functions, but little is yet known about how these loops operate and how their activities evolve during learning. To address these issues, we recorded simultaneously in sensorimotor and associative regions of the striatum as rats learned different versions of a conditional T-maze task. We found highly contrasting patterns of activity in these regions during task performance and found that these different patterns of structured activity developed concurrently, but with sharply different dynamics. Based on the region-specific dynamics of these patterns across learning, we suggest a working model whereby dorsomedial associative loops can modulate the access of dorsolateral sensorimotor loops to the control of action.National Institutes of Health (U.S.) (MH60379)United States. Office of Naval Research (N000140410208)Stanley H. and Sheila G. Sydney FundEuropean Union (Grant 201716)McGovern Institute for Brain Research at MIT (Fellowship

Habit formation coincides with shifts in reinforcement representations in the sensorimotor striatum

Smith KS, Graybiel AM. Habit formation coincides with shifts in reinforcement representations in the sensorimotor striatum. J Neurophysiol 115: 1487Neurophysiol 115: -1498Neurophysiol 115: , 2016. First published January 6, 2016; doi:10.1152/jn.00925.2015.-Evaluating outcomes of behavior is a central function of the striatum. In circuits engaging the dorsomedial striatum, sensitivity to goal value is accentuated during learning, whereas outcome sensitivity is thought to be minimal in the dorsolateral striatum and its habit-related corticostriatal circuits. However, a distinct population of projection neurons in the dorsolateral striatum exhibits selective sensitivity to rewards. Here, we evaluated the outcome-related signaling in such neurons as rats performed an instructional T-maze task for two rewards. As the rats formed mazerunning habits and then changed behavior after reward devaluation, we detected outcome-related spike activity in 116 units out of 1,479 recorded units. During initial training, nearly equal numbers of these units fired preferentially either after rewarded runs or after unrewarded runs, and the majority were responsive at only one of two reward locations. With overtraining, as habits formed, firing in nonrewarded trials almost disappeared, and reward-specific firing declined. Thus error-related signaling was lost, and reward signaling became generalized. Following reward devaluation, in an extinction test, postgoal activity was nearly undetectable, despite accurate running. Strikingly, when rewards were then returned, postgoal activity reappeared and recapitulated the original early response pattern, with nearly equal numbers responding to rewarded and unrewarded runs and to single rewards. These findings demonstrate that outcome evaluation in the dorsolateral striatum is highly plastic and tracks stages of behavioral exploration and exploitation. These signals could be a new target for understanding compulsive behaviors that involve changes to dorsal striatum function